DDL-MVS: Depth Discontinuity Learning for Multi-View Stereo Networks

نویسندگان

چکیده

We propose an enhancement module called depth discontinuity learning (DDL) for learning-based multi-view stereo (MVS) methods. Traditional methods are known their accuracy but struggle with completeness. While recent have improved completeness at the cost of accuracy, our DDL approach aims to improve while retaining in reconstruction process. To achieve this, we introduce joint estimation and boundary maps, where maps explicitly utilized further refinement maps. validate idea by integrating it into existing MVS pipeline depends on high-quality map estimation. Extensive experiments various datasets, namely DTU, ETH3D, “Tanks Temples”, BlendedMVS, show that method improves quality compared baseline, Patchmatchnet. Our ablation study demonstrates incorporating proposed significantly reduces error, instance, more than 30% DTU dataset, leads both smooth regions. Additionally, qualitative analysis has shown reconstructed point cloud exhibits enhanced without any significant compromise Finally, reveal model strategies exhibit strong generalization capabilities across datasets.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

A Integrated Depth Fusion Algorithm for Multi-View Stereo

In this paper, we propose a new integrated depth fusion algorithm for multi-view stereo. Starting from an embedding space such as the visual hull, we will first conduct robust 3D depth estimation (represented as 3D points) based on image correlation. Next a volumetric saliency weighted normal vector field is constructed from which a watertight 3D surface can be extracted using the graph cut alg...

متن کامل

Learning a Multi-View Stereo Machine

We present a learnt system for multi-view stereopsis. In contrast to recent learning based methods for 3D reconstruction, we leverage the underlying 3D geometry of the problem through feature projection and unprojection along viewing rays. By formulating these operations in a differentiable manner, we are able to learn the system end-to-end for the task of metric 3D reconstruction. End-to-end l...

متن کامل

High Accuracy Depth Measurement using Multi-view Stereo

A novel scheme for depth extraction is achieved using a multiple view ring camera system. The ring camera method captures a series of images of scene from a set of camera locations arranged in a circular ring. Tracking of scene features through this sequence realizes circular feature trajectories. The recovery of depth can be obtained with this method by determining the diameter of the circular...

متن کامل

Prioritized Multi-View Stereo Depth Map Generation Using Confidence Prediction

In this work, we propose a novel approach to prioritize the depth map computation of multi-view stereo (MVS) to obtain compact 3D point clouds of high quality and completeness at low computational cost. Our prioritization approach operates before the MVS algorithm is executed and consists of two steps. In the first step, we aim to find a good set of matching partners for each view. In the secon...

متن کامل

Learning Depth from Stereo

We compare two approaches to the problem of estimating the depth of a point in space from observing its image position in two different cameras: 1. The classical photogrammetric approach explicitly models the two cameras and estimates their intrinsic and extrinsic parameters using a tedious calibration procedure; 2. A generic machine learning approach where the mapping from image to spatial coo...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Remote Sensing

سال: 2023

ISSN: ['2315-4632', '2315-4675']

DOI: https://doi.org/10.3390/rs15122970